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Abstract 

We give a nontrivial algorithm for the satisfiability problem for en- wire threshold circuits of 
depth 2 which is better than exhaustive search by a factor 2 s ™ where s — l/c°^ c '. We believe 
that this is the first nontrivial satisfiability algorithm for cn-wire threshold circuits of depth 
2. Our proof provides a characterization of the set of satisfying solutions of such a circuit as 
the union of the 0-1 solutions of at most 2^ 1 ~ s ^ n systems of linear equations. Our algorithm 
generalizes to arbitrary symmetric gates. It also applies to the special case of the feasibility of the 
0-1 integer programming problem with linear size constraints. It is an independently interesting 
question whether there are nontrivial exponential time algorithms for integer programming. To 
our knowledge, our algorithm is the first to establish such an upper bound on the complexity of 
integer programming with linear size constraints. 

One of our motivations is proving strong lower bounds for TC° circuits, exploiting the connec- 
tion (established by Williams) between satisfiability algorithms and lower bounds. Our second 
motivation is to explore the connection between the expressive power of the circuits and the 
complexity of the corresponding circuit satisfiability problem. 

A key idea underlying our algorithm is a novel random restriction technique where we use a 
game-theoretic argument to find a suitable parameter to simplify the circuit. 
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1 Introduction 



Satisfiability testing is both a canonical NP-complete problem ([HE]) and one of the most successful 
general approaches to solving real-world constraint satisfaction problems. In particular, optimized 
CNF-SAT heuristics are used to address a variety of combintorial search problems successfully in 
practice, such as circuit and protocol design verification. The exact complexity of the satisfiability 
problem is also central to complexity theory, as demonstrated by Williams [8], who has showed 
that any improvement (by even a super polynomial factor compared to exhaustive search) for the 
satisfiability problem for general circuits implies circuit lower bounds. Furthermore he has success- 
fully used the connection to prove superpolynomial size bounds for ACC circuits using a a novel 
nontrivial satisfiability algorithm for ACC circuits, solving a long standing open problem [9j. 

This raises the questions: For which circuit models do non-trivial satisfiability algorithms exist? 
How does the amount of improvement over exhaustive search relate to the expressive power of the 
model (and hence to lower bounds)? Can Satisfiability heuristics for stronger models than CNF's 
be useful for real-world instances? 

Both the connection to circuit lower bounds and to heuristic search algorithms point to threshold 
circuits as the model to study next. Bounded-depth threshold circuits TC° are the next natural 
circuit class stronger than AC Co, and lower bounds are only known for the special case of depth 
2 such circuits [2]. For larger depth, we have barely nonlinear lower bounds on the number of 
wires |4]. On the other hand, another very useful heuristic technique for search and optimization 
problems is Integer Linear Programming. Testing the feasibility of a region for a zero-one ILP is 
equivalent to testing satisfiability of a circuit with two levels, the bottom consisting of threshold 
gates and the top level being a conjunction. So both theoretical and real-world motivation points 
us to trying to understand the satisfiability problem for depth two threshold circuits. 

In this paper, we give the first non-trivial Satisfiability algorithm for linear-sized depth two 
threshold functions, getting a constant savings in the exponent over exhaustive search. As a 
consequence, we also get a similar result for linear-sized ILP with small coefficients. Our algorithm 
also extends to arbitrary symetric gates. We consider this just a first step to a real understanding 
of the satisfiability problem for threshold circuits. 

2 Notation 

Let V be a set of variables with \V\ = n. An assignment on V is a function V — > {0, 1} that assigns 
every variable a Boolean value. A restriction is an assignment on a set U C V. 

A symmetric gate on n variables x%, . . . , x n is defined by weights Wi € Z for 1 < i < n and an 
output function g : Z — > {0, 1}. The output of the symmetric gate is g (%2i=i w i x i)- The fan-in of 
the symmetric gate is Y17=i \ w i\- ^ n other words, we consider weights other than —1,0, and 1 as 
multiple wires from the same variable. We call a variable an input to a gate if the corresponding 
weight is nonzero. For a given assignment b\, . . . , b n , we call the weighted sum Y^i=i biWi the value 
of the gate. We also extend the definition of a symmetric gate to <i-ary symmetric gates whose 
inputs and outputs are d-ary. 

A threshold gate is a symmetric gate where the output function is a threshold function, i.e., 
g(x) = 1 if x > A and g(x) = otherwise for some threshold A. 

For a collection of threshold gates, the number of wires is the sum of their fan-ins. A depth-2 
threshold circuit consists of a collection of m threshold gates (called the bottom-level gates) on the 
same n variables and a threshold gate (called the top-level gate) on the outputs of the bottom-level 
gates. The output of the circuit is the output of the top-level gate. For a G?-ary depth-2 threshold 
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circuit, the gates are d-ary gates and the top-level gate only outputs Boolean values. The number 
of wires of a depth-2 threshold circuit is the number of wires of the bottom-level gates. For all 
our circuits, we assume that the fan-in of the top-level gate is polynomially bounded although this 
condition can be relaxed considerably. We call a threshold circuit sparse if the the number of wires 
is linear in the number of variables. 

A satisfiability algorithm for depth-2 threshold circuits is an algorithm that takes as input a 
depth-2 threshold circuit and outputs an assignment such that the circuit evaluates to 1 under the 
assignment. 

A linear function on a variable set x\, . . . , x n is a function g(x±, . . . , x n ) = Ya=i w i x %^ where 
Wi £ Z are called the coefficients. The size of a linear function is the sum of the absolute values of 
the coefficients. A linear equation is an equation of the form g(xi, ■ ■ ■ , x n ) = a for some a £ Z and 
a linear g, and a linear inequality is an inequality of the form g(xi, . . . , x n ) > a. 

An algorithm for the Integer Programming Feasibility Problem takes as input a collection of 
linear inequalities on variables x±, . . . , x n , and outputs an assignment {x\, . . . , x n } — > Z such that 
all inequalities are satisfied. We call an inequality of the form 0< Xi<d— la capacity constraint. 
In a 0-1 Integer Programming Feasibility Problem each variables is constrained to be or 1. 

We use 0{f{n)) to denote the asymptotic growth of a function / ignoring polynomial factors. 
Informally, we say an algorithm is nontrivial, if its run time is significantly better than exhausitve 
search. If A is a satisfiability algorithm for circuits with n variables with run time 6 (2( 1 - s )™), we 
call s the savings of the algorithm over exhaustive search. 

All logarithms are base 2 unless noted otherwise. 

3 Results and Techniques 

The main contribution of the paper is a nontrivial satisfiability algorithm for sparse threshold 
circuits of depth 2. More precisely, we prove the following: 

Theorem 3.1. There is a satisfiability algorithm for depth-2 threshold circuits on n variables with 
cn wires with running time O (2( 1 ~ s )™) where 

1 

While the proof in Section [5] assumes a Boolean circuit for simplicity, the proof easily extends 
to threshold circuits with <i-ary inputs, yielding the following corollary. 

Corollary 3.2. There is a satisfiability algorithm for depth-2 threshold circuits on n d-ary variables 
with cn wires with running time O (d( 1-s -* n ) where 

1 

In the following, we provide a high level description of our algorithm. The idea is to select a 
random subset U of variables of size (1 — p)n so that for each assignment to the variables in U, the 
circuit becomes simpler. In particular, for each assignment of U, we would like most of the bottom- 
level gates of the circuit to depend on at most one variable and that the number of exceptional gates 
(those that depend on more than one variable) to be small. For each exceptional gate (including the 
top-level gate), we guess its value, write a linear equation, and check whether a Boolean assignment 
to the variables simultaneously satisfies the linear equations using a nontrivial algorithm due to 
Williams [7], where he uses fast matrix multiplication algorithm to achieve constant savings in the 
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run time. However, we need the overhead for guessing the values to be smaller than the savings 
achieved with the fast matrix multiplication technique. For this, it is crucial that the number of 
exceptional gates is not too large. 

One possible approach would be to select p so that there are few gates with fan-in larger than 
|. The intuition is that we can expect the gates with fan-in smaller than | to depend on at most 

one variable after simplification. If the number of gates with fan-in larger than - is not too large, 
we will succeed. However, it is not clear apriori that such a p exists. No matter what p one (the 
algorithm designer) selects, the circuit designer might select only gates with fan-in slightly larger 
than ~, thus making the number of exceptional gates too large. 

Our first successful attack is an analytical argument, which shows that for every threshold circuit 
with at most cn wires at the bottom-level, there is a p > which is only doubly exponentially small 
such that there are not too many gates whose fan- in is slightly above -. Evidently, there cannot 
be too many gates with fan-in much larger than -, since the total number of wires is constrained. 
This argument yields a savings which is doubly exponentially small in c. However, it is useful to 
model the interplay between the parameter p and the circuit as an explicit zero-sum game, where 
the first player's (the algorithm designer) pure strategies are the values of p and the second player's 
(the circuit designer) pure strategies are the circuits where all the gates have the same fan-in. The 
payoff is the difference between the savings achieved by the Williams's algorithm and the overhead. 

The mixed strategies of the circuit designer are threshold circuits with at most cn bottom-level 
wires, where each such circuit is viewed as a distribution of the total number of wires among gates 
of different fan-in. The mixed strategies of the algorithm designer are distributions on the values 
of p. We then apply the Min-Max theorem to lower bound the expected value of the game by 
exhibiting a distribution (with finite support) on the values of p. We then search through the 
values in the support of the distribution to find a p that produces the expected value. This game- 
theoretic analysis yields an overall satisfiability savings which is only single exponentially small in 
c. 

We observe that the same ideas easily extend to arbitrary symmetric gates, as we only require 
that the value of the gate uniquely determine its output. 

Since the Integer Programming Feasibility Problem with capacity constraints can be expressed 
as a depth-2 threshold circuit with an AND gate as the top-level gate, the results translate directly 
to the feasibility version of sparse Integer Programs with capacity constraints, and 0-1 Integer 
Programs in particular. We get 

Corollary 3.3. Let {g± > ai,...,g m > a m } be a collection of linear inequalities in variables 
{x\, . . . ,x n } with total size at most cn. There is an algorithm to find an integer solution to the 
linear inequalities with capacity constraints < Xj < d — 1 for all i with running time 6 (d^ s ^ n ) 
for 

1 

The following three sections contain the details of the proof. Section |4] gives a nontrivial 
algorithm with constant savings for finding a Boolean solution to a system of linear equations. 
This algorithm follows the ideas of Williams [7], who provides a nontrivial algorithm with constant 
savings for the Max-2-Sat problem using fast matrix multiplication technique. Section [5] presents 
the satisfiability algorithm for threshold circuits where the probability p is treated as a parameter. 
In section [U we show how to select the parameter p using the Min-Max theorem to yield the claimed 
savings. 
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4 Solving Systems of Linear Equations 



In this section we describe an algorithm to find a Boolean solution to a system of linear equations. 
The algorithm was presented by Williams [7] in the context of Max-2-Sat, i.e., the problem of 
finding an assignment that satisfies the maximum number of clauses of a 2-cnf. We apply the 
algorithm to find Boolean solutions of quadratic equations. 

A crucial component of the algorithm is fast matrix multiplication, and the runtime depends on 
the matrix multiplication exponent, the smallest uj such that two n x n matrices can be multiplied 
in time 0(12^). The current best bound on to is to < 2.3727 |10j . 

Lemma 4.1. Let f(x±, . . . ,x n ) be a degree two polynomial in n variables with integer coefficient 
between —B and B. Assume f has no constant term. There is an algorithm which takes such an 
f and an a € Z as inputs and decides whether f(xi,...,x n ) = a can be satisfied by a Boolean 
assignment in time O ^B 2 ra 4 2 3"™^ , where to is the matrix multiplication exponent. 

Proof. Let V = {x±, . . . ,x n } be the set of n variables. For an assignment (3 : W — > {0, 1}, where 
W C V, let (3* : V — > {0, 1} be the assignment that agrees with j3 on all variables in W, and 
sets all other variables to 0. Furthermore, let f((3) be shorthand for /(/?*). For two assignments 
P : W -> {0, 1} and 7 : U -> {0, 1} on disjoint sets W and U, let /3j : W U U -> {0, 1} be the 
assignment that agrees with j3 on W and with 7 on U. If a monomial has both its variables in 
W, then it contributes to /(/?7) as well as /(/?)■ On the other hand, if a monomial has one of its 
variables in W and the other in U, then it contributes to only f(/3j). 

Let V±,V2 and V3 be a partition of V into sets of size ^ each and let f3 be any assignment on 
V±, 7 be an assignment on V2 and 5 be an assignment on V3. Then 

fW) = /(/3 7 ) + /( 7 5) + /(5/3) - f(j3) - /( 7 ) - f(5) 
= (/G87) " |/03) " 5/(7)) + (/(7«5) " 5/(7) " 

+ (/(^) - \m - \m) 

since each monomial makes a net contribution of one to each side of the equation. More specifically, 
every monomial contributes exactly once to the left side of the equation. If a monomial has both 
its variables in the same set, say V±, it contributes to /(/?), /(/3 7 ) and f(5(3) so that the algebraic 
contribution is 1. If a monomial has one in variable in one part and the other in a different part, 
say V\ and V2, then it contributes exactly once to /(P'y). 

The algorithm computes three 23 x 2 3 matrices B,C and D, where -Bg i7 = f(Pj) — \f{P>) — 
|/(7), C 7i5 = f( 7 S) - |/( 7 ) - \f{8) and D tf)j8 = f(6p) - \f(5) - \f(fi). We can construct these 
matrices in time 0(n 2 )2"3" and the entries of the matrix are integers between —Bn 2 and Bn 2 . 
Furthermore, for a matrix M, let be the 0-1 matrix which is 1 at an entry if and only if 

the corresponding entry in M is m. There is an assignment a : V — > {0, 1} such that /(a) = a 
if and only if there are numbers b,c and d with b + c + d = a and assignments /3, 7 and 5 such 
that Br 7 = 6, C 7j( 5 = c, -D<5 I( 3 = d Therefore, for fixed numbers 6, c and d, there are assignments 

j3, 7 and 5 satisfying those conditions if and only if (B^C( C ')„ 5 > 1 and = 1. Using a fast 
matrix multiplication algorithm with exponent to = 2.3727, we can multiply B^ and in time 

Since there are at most AB 2 n 4 combinations of numbers b, c, d with b + c + d = a, the overall 
time complexity of the algorithm is O (B 2 n i 2s n \ . □ 
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Corollary 4.2. Let T = {/i, . . . , f m } be a collection of linear functions on n variables with integer 
coefficients between —D and D. Then we can find a Boolean solution to the system of equations 
fi(xx, . . . ,x n ) = 0, . . . ,f m (xi, . . . ,x n ) = in time O [m 2 D A n A 2^ n ^ . 

Proof. The system of equations is equivalent to YliLi ffi x ^-> ■ ■ ■ -> x n) = 0- For f 2 , the coefficients 
are between —2D 2 and 2D 2 . Since we sum over m quadratic functions, every coefficient in the 
quadratic equation is bounded by 2mD 2 and the corollary follows from Lemma 14.11 □ 

We use s w = 1 — £ to denote the savings of the Williams's algorithm. We observe that the time 
complexity of the algorithm is O (2( 1-s ") n ) for D and m polynomial in n. 



5 The Algorithm 

We develop the algorithm in three stages. In the first stage, we present a satisfiability algorithm for 
depth-2 threshold circuits with cn wires where all the bottom-level gates have the same fan- in /. 
The algorithm further depends on a parameter p and achieves savings s p t . For certain combinations 
of p and / the savings might be negative. In the second stage we extend the algorithm to threshold 
circuits with varying fan-in and show that the savings of the algorithm is a convex combination of 
s p j. In the final stage, in Section [6] we show how to select a p such that the savings is at least 
—7-5- for any distribution on /. 

As we are mainly interested in the savings, we look at the logarithm of the time complexity and 
bound its expectation. 

Lemma 5.1. Let < p < 1 be a parameter and C be a depth-2 threshold circuit on variables V = 
{xi, . . . ,x n } with at most cn wires, and fan-in f for all bottom-level gates. There is an algorithm 
that decides the satisfiability for such C with time complexity T such that E[log(T)] = (1 — s p j)n 
for 
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s^p — j log (-^jcpf) otherwise 



Proof. We select a random subset U C V such that a variable is in U with probability (1 — p) 
independently. We note that E[|Z7|] = (1 — p)n. For each of the 2^' assignments to U, we solve 
the satisfiability problem of the simplified circuit. Bottom-level gates where all inputs are in U are 
removed and the threshold of the top-level gate is adjusted appropriately. Gates that only depend 
on one input are replaced by a direct wire to the top-level gate with an appropriate weight and 
adjustment to the threshold of the top-level gate. For all gates with at least two remaining inputs, 
we guess the value of the gate and express the gate as a linear equation. Similarly, we guess the 
value of the top-level gate to get another linear equation. Using corollary 14.21 we solve the resulting 

system of linear equations on n' = n — \U\ variables in time O ^2^ 1_s ") n '^ with savings s w = 1 — ^. 

The critical part of the analysis is bounding the overhead from guessing the values of the gates. 
We first bound the number of distinct values a gate can take. The top-level gate can only take 
polynomially many different values. Consider a bottom-level gate with fan-in I > 2 after applying 
an assignment to the variables in U. We bounds the number of distinct values that the gate can 
take in two different ways. The number of possible inputs, and hence the number of possible values 
is bounded by 2 l . On the other hand, since the value is an integer between —I and Z, the number 
of possible values for the gates is also upper bounded by 21 + 1. Hence, we use min{2 / ,2Z + 1} as 
an upper bound for the number of values of a bottom- level gate with fan- in I. 
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Since we have a control on the number of distinct values taken by a gate by assumption, our 
overhead crucially depends on the number of exceptional gates, gates that depend on more than 
one variable after applying an assignment to the variables in U. Intuition says that the number 
of exceptional gates should be small. If the fan-in of a gate is small, then we expect that it will 
simplified to depend on at most one variable after assigning values to the variables in U. On the 
other hand, there cannot be too many gates of large fan-in. While the intuition is simple, it is 
tricky to make it work for us in the general context. At this stage, our focus is on estimating the 
savings s p j for the probability parameter p and the fan-in /. 

Let H bea random variable denoting the overhead. Our estimation of overhead and s p j involves 
two cases. Let t = We first consider the case pf < t. Let U' C V — U be the set of variables 
that appear in exceptional gates. Our goal is to upper bound E[log(//)] < E [[/"']. 

Consider a bottom-level gate. Let X be the random variable denoting the number of its inputs 
not in U. Let /' < / be the number of variables the gate depends on, and let X be the random 
variable denoting the number of its inputs not in U. The distribution of X is Bin(/',p), hence we 
have ELY] = f'p. Let the random variable Y denote the number of variables that the gate can 
contribute to U' . Since U' is the set of variables appearing in exceptional gates, we have Y = X 
for X > 2 and Y = otherwise. Hence 

E[Y] = ELY] - PLY = 1] < f'p - f'p(l - p)V'-V 
<f'p(l-(l-p)f')<f'p(l-(l-f'p)) 
= (f'p) 2 < (fp? 

by Bernoulli's inequality. Hence, for any variable x which is an input to the gate, the probability 
x belongs to U' is at most < p 2 f < Since the total number of wires is bounded by cn, we 

have E[log(tf)] < E[\U'\] = cn^ = Ogn. 

For the logarithm of the time complexity this yields 



E[log(T)] = E[\U\] + E [(1 - O (n - \U\)} + E 



s^p 



-n 



< n 1 - 



s^p 



ignoring logarithmic factors from both the polynomial factors of Williams' algorithm and the over- 
head from guessing the value of the top-level gate. We have s p j = 

We now consider the case pf > t. Suppose the i-th gate has k inputs that are not in U. The 
expected value of U is pf. There are at most 2Zj + 1 possible values for the gate. Since all the 
bottom-level gates have the same fan- in /, the number of bottom- level gates is at most cn/ f and 
E[J2i2/i h] = P cn - We bound the expected logarithm of the number of possible values of all gates 
by 



E 




(2k + 1) 



cn/f 



(cn/f) E [(log(2Zi + l)//cn)] < (cn/f) log(2p/ + 1) 



< (cn/f) log ^— cpf 

where we use the concavity of the logarithm function in the penultimate step and the fact pf > || 
in the last step. 

For the logarithm of the time complexity we get, 



E[|C7|]+E[(l- S -)(n-|C/|)]+E 



cn/f log ( -j-cpf 



< n ( 1 - ( s u p - j log ( — cpf 
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with savings s p j = s^p — % log (jbcpf) . 

□ 

We now extend the algorithm to circuits with varying fan-in and show that the logarithm of 
the time complexities is lower bounded by a convex combination of the savings s p j. We model 
the cn- wire circuits of varying fan- in by a distribution T on wires. For each fan-in /, the wire 
distribution T specifies the number cyn of wires of bottom-level gates of fan-in /. We denote the 
savings of our algorithm on circuits with wire distribution T by s p ^. 

Lemma 5.2. Let < p < 1 be a parameter and let C be a depth-2 threshold circuit on n variables 
with at most cn wires, where the wires are distributed according to T . There is a satisfiability 
algorithm for such C with time complexity T such that E[log(T)] = (1 — s Pi j^)n for 

n 

S P ,T > ^ 8 P,f 
/=1 

Proof. The algorithm is the same as above. The logarithm of the overhead of guessing the values 
for all bottom-level gates with fan-in / is log(ifj) = log (^|cp/) if pf > t and log(iTf) = 
^r^-^-n otherwise. Solving the system of linear equations using corollary 14.21 and using linearity of 
expectation then yields the savings as claimed. □ 

6 The Algorithm as a Zero- Sum Game 

The time complexity of the algorithm in Section [5] depends crucially on choosing a suitable parame- 
ter p. Instead of trying to directly determine a good parameter p by analyzing the wire distribution 
of the circuit, we apply a trick from game theory. 

A zero-sum game with two players A and C is a game where both players pick a strategy and 
the outcome is determined by a function of the two strategies. Player A tries to maximize the 
outcome, while player C tries to minimize it. The Min-Max Theorem states that it does not matter 
which player moves first, as long as we allow mixed strategies for the players. 

We model the task of choosing the parameter p as the following zero-sum game: Player A, 
the algorithm designer, picks some probability p, and player C, the circuit designer, picks a value 
/. The outcome is s p j, the savings of the algorithm. The algorithm designer tries to maximize 
the savings, and the circuit designer tries to minimize it. The wire distribution of a circuit is a 
mixed strategy for the circuit designer. A mixed strategy for the algorithm designer A would be a 
distribution on the probabilities. 

A direct approach for designing the algorithm would be to select the parameter p depending on 
the circuit so that we obtain large savings. Specifically, given the wire distribution of the circuit J 7 , 
the algorithm designer picks a p and and the outcome s Pt jr is a convex combination of the values 
s p j. Using the Min-Max Theorem we turn this game around: The algorithm designer picks a mixed 
strategy and the circuit designer responds with a pure strategy /, a circuit where all bottom-level 
gates have fan-in /. The following lemma shows that there is a good strategy for the algorithm 
designer. 

Lemma 6.1. There is a distribution T> on parameters p such that for all f , 

Ep~73 [*„,/] > 
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Proof. Let T> be the following distribution on p: For / = O (c 2 log(c)) with suitable constants, 
and 1 < i < /, we set p = 2~ % with probability A ■ 2~(- f ~* +1 ), where A = -=j , is the 

Ei=i 2 1 

normalization factor. We know that 1 < A < 2. The expectation of p is E[p] = 

Let / be any pure strategy of the circuit designer and J = log(/). The expected outcome of 
the game for these strategies is 

/ 

i=l 

To lower bound the expected outcome, we use a case analysis on the savings similar to the one 
in Section [5) Let t = y- as defined in the previous section. Let I' < I be the largest value such 
that for i < I', we have 2 J ~ % > t and for I' < % < I we have 2 J ~ l < t. 

Using the savings from lemma [5TTI we have s 2 -i 2 ./ = 2"*s w — log (^■c2 l7_ *) for 2 J ~ i > t and 
s 2~ i ,2 J = 2 2 otherwise. The expected savings is then 

/ 

i=l 

= E 2 ~"~ i+1) ( 2 -"" - £ ^ ) + E ; 2H '- +1) ^ 
> E *-"-*"> Kf - E 2 ' (M+1) f "* (> J -') 

1=1 1=1 v / 

Let j = [(J — «)] . By the definition of I' we have j > log(t) = — log(c) + log (^-) . Hence 

E 2 - (J -' ) * ( s E 2 "' + log ) 

i=l V y j=log(t) V \ // 



i=i 

0(clog(c)) 



Hence for I = O (c 2 log(c)) we get 



.0( C 2) 



□ 



We now conclude that for every / there is a p = 2 % for 1 < i < I, such that s p j > 
Using that for every mixed strategy for /, the savings is a convex combination of the savings for 
pure strategies, we conclude the same for any strategy on /. 

This gives us the final algorithm: Given a circuit C with wire distribution J 7 , evaluate Ej^j-[s p j] 
with p = 2~ % for each 1 < i < I as above and use the optimal p for the random restriction. 

The savings is tight in the sense that there is a mixed strategy on / such that the expected 
savings is at most l/2 n(c ). 
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Lemma 6.2. There is a wire distribution J- such that for any p 



2 fi(c) 



Proof. Let p be the strategy of the algorithm designer and et T be the distribution such that for 
1 < j < c, c 2 j = 1 and c/ = for any other /. By lemma [5721 we have 



c 1 



-,23 



We argue that for large c and p > the savings is negative. Assume p > There is some j* < c 
such that for f = 2 J , 1 < pf < 2. Using that for any p and /, the savings s p j is upper bounded 
by s^p we get 



c 1 



< s w p - -s p 2j * 

1 c / 4 
= s u p --—^log —cpl 3 
c 2-> \ s^ 

<p(^-Ulog(^c)+l 



For large c, the expectation is therefore negative. On the other hand, if p < then Ef^jr[s p j] < 



i 



2 C 2«( c ) ' 



□ 



7 Conclusions 

In this paper, we present the first nontrivial algorithm for deciding the satisfiability of cn-wire 
threshold circuits of depth 2. The result extends to the more general case of circuits with symmetric 
gates. The same result also applies to the special of case of 0-1 integer programming feasibility 
problem with sparse constraints. The algorithm improves over exhaustive search by a factor 2 sn 
where s = l/c°^ c \ 

Several straightforward open questions remain. Can we improve the savings for sparse depth-2 
threshold circuits? The savings in our algorithm is exponentially small in c, while the best known 
savings for era-size AC circuits is only polylogarithmically small in c [3]. Can we decrease this gap? 
If not, can we explain it in terms of expressive power of the circuits? 

Our algorithm handles only restrictive versions of threshold circuits of depth-2. Can we obtain 
nontrivial satisfiability algorithms for slightly more relaxed models? For example, it would be 
interesting to extend the result to depth-2 circuits with more wires. It would be very interesting 
to extend the result to larger depth circuits. 

Our algorithm follows the general framework described by [6]: convert the input circuit to a 
simpler representation of the same function, and then solve Satisfiability for that representation. 
In [6], the representation was a decision tree. [3] used a more general representation, a partition 
of the Boolean cube into sub-cubes where the function was constant. Here, we are implicitly using 
an even more general representation: a partition of the cube into affine sub-spaces over the reals 
on which the function is constant. Unlike earlier work, the satisfiability problem is not easy even 
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for the simpler representation; instead of being polynomial time for each sub-space, we get only an 
improved exponential time. This motivates two further questions: What is the exact complexity 
of finding a Boolean point in a sub-space given as a system of linear equations? We reduce this 
problem to that of finding a solution to a 2-CSP satisfying exactly a given number of constraints, 
but there may be more direct approaches. Another question raised is to look at the size of such a 
partition as a measure of complexity for Boolean functions. Can we find explicit functions requiring 
almost exponentially many such sub-spaces for such a partition? Can we use this to prove lower 
bounds for threshold circuits? 

Finally, our algorithm takes exponential space, because this is required for Williams' algorithm. 
Can we reduce the space requirement to polynomial space? 
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